Method and apparatus for using gestures in a refrigerator dispensing system

ABSTRACT

A refrigeration device includes a refrigerated compartment, a door that seals the compartment, a dispenser opening in an exterior surface of the door, and a dispenser outlet in the opening. The refrigeration device also includes a reservoir configured to hold a substance and a conveyor configured to convey the substance from the reservoir to the dispenser outlet. Measurement sensors of the refrigeration device are configured to generate first measurement signals that are indicative a gesture of a hand in the dispenser opening. A control unit of the refrigeration device is configured to ascertain a requested fill height based upon the first measurement signals. The control unit is further configured to generate signals that cause the conveyor to convey the substance from the reservoir to a container placed under the dispenser outlet and cease conveying the substance upon the container attaining the requested fill level.

FIELD OF THE DISCLOSURE

The present disclosure generally relates to refrigerators, freezers, andother refrigeration devices and more specifically to dispensers of suchrefrigeration devices.

BACKGROUND

Refrigerators commonly include an in-door water and/or ice dispenser.The in-door dispenser is generally accessible from an exterior of therefrigerator. In particular, the dispenser is incorporated in therefrigerator door such that the dispenser may selectively dispensechilled water and/or ice while doors of the refrigerator are in a closedposition. Thus, a person may obtain chilled water and/or ice from therefrigerator without opening a refrigerator door. Opening a refrigeratordoor warms the accompanying refrigerated compartment. Accordingly,in-door dispensers may help the refrigerator operate more efficiently byreducing the number of cooling cycles for the refrigeration system thatmaintains the refrigerated compartment at a desired temperature.

To this end, such dispensers commonly include a lever or button that, inresponse to being pressed or otherwise activated, causes the dispenserto dispense water and/or ice from a spigot and/or chute. The lever orbutton may be placed in relation to the spigot and/or chute such that acontainer positioned below the spigot and/or chute activates the leveror button. In some example embodiments, the dispenser may also include acontrol panel having one or more buttons that a person may activate inorder to cause the dispenser to dispense water and/or ice. Regardless ofwhether the dispenser is operated via the lever or a control panelbutton, the person must remain attentive in order to deactivate theactivated lever or button at the appropriate time to achieve a desiredlevel of water and/or ice in the container.

BRIEF DESCRIPTION OF THE DISCLOSURE

Shown in and/or described in connection with at least one of thefigures, and set forth more completely in the claims are dispensingsystems and methods that detect a requested level of water, ice, and/orsome other dispensed substance based on one or more hand gestures andthat fill a container with the dispensed substance to the requestedlevel.

These and other advantages, aspects and novel features of the presentdisclosure, as well as details of illustrated embodiments thereof, willbe more fully understood from the following description and drawings.

BRIEF DESCRIPTION OF SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 shows a refrigerator having a side-by-side arrangement ofrefrigeration compartments and a dispenser in accordance with an exampleembodiment.

FIG. 2 shows a refrigerator having a top-freezer arrangement ofrefrigeration compartments and a dispenser in accordance with an exampleembodiment.

FIG. 3 provides a block diagram that depicts further details of theexample refrigerators shown in FIGS. 1 and 2 .

FIG. 4 provides a block diagram that depicts further details of theexample dispensers shown in FIGS. 1 and 2 .

FIG. 5 shows a flowchart of an example dispensing method implemented bythe dispenser shown in FIGS. 1 and 2 .

FIG. 6 depicts a container in an opening of the dispenser of FIGS. 1 and2 as well as an example flat hand gesture for requesting a height towhich the container is to be filled.

FIG. 7 depicts a container in an opening of the dispenser of FIGS. 1 and2 as well as another example hand gesture for requesting a height towhich the container is to be filled.

FIG. 8 shows a flowchart of an example flat hand gesture recognitionmethod implemented by the dispenser shown in FIGS. 1 and 2 .

FIG. 9 shows a flowchart of an example hand gesture recognition methodimplemented by the dispenser shown in FIGS. 1 and 2 .

FIG. 10 shows a flowchart of an example container height detectionmethod implemented by the dispenser shown in FIGS. 1 and 2 .

FIG. 11 shows a flowchart of an example substance level monitoringmethod implemented by the dispenser shown in FIGS. 1 and 2 .

DETAILED DESCRIPTION

The following discussion presents various aspects of the presentdisclosure by providing examples thereof. Such examples arenon-limiting, and thus the scope of various aspects of the presentdisclosure should not necessarily be limited by any particularcharacteristics of the provided examples. In the following discussion,the phrases “for example,” “e.g.,” and “exemplary” are non-limiting andare generally synonymous with “by way of example and not limitation,”“for example and not limitation,” and the like.

As utilized herein, “and/or” means any one or more of the items in thelist joined by “and/or”. As an example, “x and/or y” means any elementof the three-element set {(x), (y), (x, y)}. In other words, “x and/ory” means “one or both of x and y.” As another example, “x, y, and/or z”means any element of the seven-element set {(x), (y), (z), (x, y), (x,z), (y, z), (x, y, z)}. In other words, “x, y and/or z” means “one ormore of x, y, and z.”

The terminology used herein is for the purpose of describing particularexamples only and is not intended to be limiting of the disclosure. Asused herein, the singular forms are intended to include the plural formsas well, unless the context clearly indicates otherwise. It will befurther understood that the terms “comprises,” “includes,” “comprising,”“including,” “has,” “have,” “having,” and the like when used in thisspecification, specify the presence of stated features, integers, steps,operations, elements, and/or components, but do not preclude thepresence or addition of one or more other features, integers, steps,operations, elements, components, and/or groups thereof.

It will be understood that, although the terms first, second, etc. maybe used herein to describe various elements, these elements should notbe limited by these terms. These terms are only used to distinguish oneelement from another element. Thus, for example, a first element, afirst component, or a first section could be termed a second element, asecond component, or a second section without departing from theteachings of the present disclosure. Similarly, various spatial terms,such as “upper,” “lower,” “side,” and the like, may be used indistinguishing one element from another element in a relative manner. Itshould be understood, however, that components may be oriented indifferent manners, for example a component may be turned sideways sothat its “top” surface is facing horizontally and its “side” surface isfacing vertically, without departing from the teachings of the presentdisclosure.

In the drawings, various dimensions may be exaggerated for illustrativeclarity. Additionally, like reference numbers are utilized to refer tolike elements through the discussions of various examples.

The discussion will now refer to various example illustrations providedto enhance the understanding of the various aspects of the presentdisclosure. It should be understood that the scope of this disclosure isnot limited by the specific characteristics of the examples provided anddiscussed herein.

In some example embodiments, a dispenser may fill a container with adispensed substance (e.g., water and/or ice) to a requested fill level.To this end, the dispenser may detect the height of the container. Thedispenser may further ascertain the requested fill level based on one ormore observed hand gestures. The dispenser may also monitor the level ofthe dispensed substance in the container as the dispenser dispenses thesubstance into the container. In response to determining the level ofthe substance in the container has achieved the desired fill level, thedispenser may cease further dispensing of the substance.

FIG. 1 and FIG. 2 show two example arrangements for a refrigerator or arefrigeration device 10 having an in-door dispenser. In particular, FIG.1 depicts the refrigeration device 10 in a side-by-side arrangement inwhich vertical freezer and fresh foods compartments 12, 14 andrespective doors 16, 18 are positioned side-by-side. FIG. 2 depicts therefrigeration device 10 in a top-freezer arrangement in which thefreezer compartment 12 and respective freezer door 16 are positionedabove the fresh foods compartment 14 and its respective fresh food door18. The two arrangements shown in FIGS. 1 and 2 are exemplary and forillustrative purposes. Other arrangements may incorporate aspects of thepresent dispenser system. For example, the refrigeration device 10 mayinclude one, two, three, or more refrigerated compartments. Moreover,each refrigerated compartment may include one or more doors foraccessing the respective compartment.

Referring to FIGS. 1 and 2 , the refrigeration device 10 may include aninsulated partition 15 between the freezer and the fresh foodcompartments 12, 14. The refrigeration device 10 may further include afreezer door 16 and a fresh food door 18. The freezer door 16 may behung on one or more hinges 17 which permit the freezer door 16 to swingbetween an opened state and a closed state. Similarly, the fresh fooddoor 18 may be hung on one or more hinges 19 which permit the fresh fooddoor 18 to swing between an opened state and a close state. When closed,the freezer door 16 and fresh food door 18 may respectively seal off thefreezer compartment 12 and the fresh food compartment 14 from theoutside. Conversely, when opened, the freezer door 16 and fresh fooddoor 18 may grant access to the items stored in the freezer compartment12 and the fresh food compartment 14.

The refrigeration device 10 may further include a dispenser 70 in one ofthe doors 16, 18. As shown, the dispenser 70 may comprise an opening 72in an exterior surface of one of the doors 16, 18. The opening 72 isgenerally sized to receive a container 110 such that dispenser 70 maydispense a substance 120 (e.g., water and/or ice) into the container 110while the doors 16, 18 remain in a closed position. See, e.g., FIGS. 6and 7 . The dispenser 70 may be implemented as a self-containedcomponent integrated into the respect door 16, 18. In other exampleembodiments, the dispenser 70 may be implemented in a distributed mannerwith one or more components (e.g., a controller, pump, etc.) positionedat various locations in the refrigeration device 10. In network-enabledembodiments, certain aspects (e.g., gesture processing/recognition) maybe distributed beyond the refrigeration device 10 itself and rely uponprocessing capabilities of network-accessible devices that providecloud-based services.

Further exemplary details of the refrigeration device 10 are shown inFIG. 3 . As shown, the refrigeration device 10 may further include arefrigeration system 22 configured to cool the refrigerated compartments12, 14. The refrigeration system 22 may include a compressor 24, acondenser 26, an expansion valve 28, and an evaporator 30, coupled toeach other via tubing 31. The compressor 24 may compress refrigerantflowing through the refrigeration system 22. In particular, therefrigerant may flow from the compressor 24 through the condenser 26,the expansion value 28, and the evaporator 30 before returning to thecompressor 24. The evaporator 30 may refrigerate air via heat transferand the refrigerated air may be used to cool the compartments 12, 14.

In one example embodiment, the refrigeration system 22 may be configuredto maintain the freezer compartment 12 at temperatures substantiallybelow freezing (32° F.). The refrigeration system 22 may be furtherconfigured to maintain the fresh food compartment 14 at temperaturesbelow ambient temperature but above freezing (32° F.). In this manner,the freezer compartment 12 may freeze or maintain frozen items and thefresh food compartment 14 may cool items without freezing such item.

As show, the refrigeration device 10 may further include a mainmicrocontrol unit (MCU) 40. The main MCU 40 may be configured to controloperation of various aspects of the refrigeration device 10. To thisend, the main MCU 40 may include a processor 42, a memory 44, one ormore I/O ports 46, and a network interface 48. In some exampleembodiments, the processor 42, the memory 44, the I/O ports 46, and thenetwork interface 48 may be implemented with separate, discretecomponents. In other example embodiments, the processor 42, the memory44, the I/O ports 46, and the network interface 48 may be provided by asingle-chip microcontroller, which are available from various vendors.

The processor 42 may be configured to execute instructions, manipulatedata and generally control operation of other components of therefrigeration device 10 as a result of its execution. The memory 44 mayinclude various types of random access memory (RAM) devices, read onlymemory (ROM) devices, flash memory devices, and/or other types ofvolatile or non-volatile memory devices. In particular, such memorydevices of the memory 44 may store instructions and/or data to beexecuted and/or otherwise accessed by the processor 42.

The I/O ports 46 may generally provide the main MCU 40 with the abilityto send and receive data signals. In particular, one or more I/O ports46 may be coupled to other components of the refrigeration device 10 topermit the exchange of data and other communications between the mainMCU unit 40 and the other components. Moreover, one or more I/O ports 46may be coupled to various sensors used to monitor aspects of therefrigeration device 10.

The network interface 48 may enable communication with externalcomputing devices such as laptop computing devices, tablet computingdevice, smart phones, etc., via a network. To this end, the networkinterface 48 may include a wired network interface such as an Ethernet(IEEE 802.3) interface, a wireless network interface such as a WiFi(IEEE 802.11) interface, a radio or mobile interface such as a cellularinterface (GSM, CDMA, LTE, etc.), and/or some other type of networkinterface capable of providing a communications link between the mainMCU 40 and another computing device. In some other example embodiments,the main MCU 40 may be implemented without the network interface 48. Insuch embodiments, the refrigeration device 10 may simply operate withoutnetworking capabilities.

The main MCU 40 may be configured to control operation of therefrigeration system 22. To this end, the refrigeration device 10 mayfurther include temperature sensor 52, 54 coupled to I/O ports 46 of themain MCU 40. The temperature sensors 52, 54 may be respectivelypositioned in the freezer compartment 12 and the fresh food compartment14. Based on signals received from temperature sensor 52, 54, the mainMCU 40 may determine the internal temperature of the refrigeratedcompartments 12, 14 and may adjust the operation of the refrigerationsystem 22 to maintain the refrigerated compartments 12, 14 at desiredtemperature levels.

Referring now to FIG. 4 , an example implementation of the in-doordispenser 70 is shown in greater detail. The dispenser 70 may include adispenser microcontrol unit (MCU) 74. In general, the dispenser MCU 74may detect a height of a container 110 placed in the opening 72. Thedispenser MCU 74 may further discern a requested fill level based on anobserved hand gesture. Moreover, the dispenser MCU 74 may monitor thelevel of a substance 120 in the container 110 as the dispenser 70dispenses the substance 120 into the container 110 and may cease furtherdispensing in response to the monitored level attaining the requestedfill level.

To this end, the dispenser MCU 74 may include a processor 75, a memory76, and one or more I/O ports 78. In some example embodiments, theprocessor 75, the memory 76, and the I/O ports 78 may be implementedwith separate, discrete components. In other example embodiments, theprocessor 75, the memory 76, and the I/O ports 78 may be provided by asingle-chip microcontroller, which are available from various vendors.FIG. 4 depicts the dispenser MCU 74 as separate and distinct from themain MCU 40 of FIG. 3 . However, in some example embodiments, therefrigeration device 10 may include a single MCU that provides thefunctionality of both the main MCU 40 and the dispenser MCU 74.

The processor 75 may be configured to execute instructions, manipulatedata and generally control operation of other components of thedispenser 70 as a result of its execution. The memory 76 may includevarious types of random access memory (RAM) devices, read only memory(ROM) devices, flash memory devices, and/or other types of volatile ornon-volatile memory devices. In particular, such memory devices of thememory 76 may store instructions and/or data to be executed and/orotherwise accessed by the processor 75.

Finally, the I/O ports 76 may generally provide the dispenser MCU 74with the ability to send and receive data, status, and/or controlsignals. In particular, one or more I/O ports 76 may be coupled to themain MCU 40 of the refrigeration device 10 to permit the exchange ofdata and other communications between the main MCU unit 40 and thedispenser MCU 74. Moreover, one or more I/O ports 76 may be coupled toone or more measurement sensors 80, one or more proximity sensors 82, amain display 84, a level display 86, a control panel 88, and one or moresubstance conveyors 90.

The one or more measurement sensors 80 may measure, map, image, sense,and/or observe dimensional aspects of a container 110 or hand 130 placedin the dispenser opening 72. Similarly, the one or more measurementsensor(s) 80 may measure, map, image, sense, and/or observe a fill levelof a substance 120 dispensed into a container 110 placed in thedispenser opening 72. To this end, the measurement sensors 80 mayinclude ultrasonic sensors, hand gesture sensors, radar sensors,electromagnetic field sensors, LIDAR sensors, 3D scanners, cameras,imaging sensors, and/or other sensors capable of generating signals fromwhich measurements of the container 110, substance 120, and/or hand 130may be obtained. Further details regarding various implementations ofthe measurement sensors 80 are presented below.

The one or more proximity sensors 82 may generate and provide thedispenser MCU 74 with a status signal indicative of whether theproximity sensor 82 detects placement and/or removal of an object (e.g.,a container 110 and/or user's hand 130) into and/or from the dispenseropening 72. To this end, the one or more proximity sensor 82 may bepositioned along a perimeter (e.g., left, right, bottom, and/or topsides) of the dispenser opening 72 and/or within the dispenser opening72. In some example embodiments, the one or more proximity sensors 82are implemented with one or more low power, short range sensors (e.g.,ultrasound sensors) having a detection range, which collectivelyencompass or substantially encompass the dispenser opening 72. Moreover,the proximity sensor 82 may be implemented as an always-on sensor or asa periodically-activated (e.g., every 100 milliseconds) sensor. As such,from the perspective of a user, the one or more proximity sensor 82 mayeffectively continually monitor the dispenser opening 72 even if theproximity sensors 82 have short periods of inactivity in order toconserve power.

In some example embodiments, each proximity sensor 82 has arelatively-short, detection range (e.g., 1-8 inches) that extendsradially from the respective sensor 82. Such proximity sensors 82 may bedistributed about or in the dispenser opening 72 such that thecollective detection range of the proximity sensors 82 substantiallyencompasses the dispenser opening 72 and its interior.

The main display 84 may present feedback and/or other information to theuser of the refrigeration device 10. In particular, the main display 84may include status LEDs (light-emitting diodes), liquid crystaldisplays, a graphical display, etc., via which the main MCU 40 and/orthe dispenser MCU 74 provide status information and/or messages.

The level display 86 similarly may present feedback and/or otherinformation to the user of the refrigeration device 10. Morespecifically, the level display 86 provides the user with feedbackregarding the requested fill level detected by the dispenser 70, thusproviding the user with visual confirmation that the dispenser hasappropriately detected the user's requested fill level. Such fill levelfeedback may be presented via a number of different ways includingilluminating appropriate LEDS, presenting a graphical display, etc. Assuch, in some example embodiments, the main display 84 may provide thefeatures of the level display 86 or the level display 86 may beincorporated into the main display 84.

However, in one example embodiment, the level display 86 is implementedvia a controllable, illuminating pointing device (e.g., laser pointer,LED pointer, etc.) directed toward the dispensing opening 72. Morespecifically, the pointing device may be mounted to a servomotor orother controllable device that is configured to direct light emitted bythe pointing device based on one or more control signals of thedispenser MCU 74. Alternatively, the pointing device may be mounted in afixed manner and a mirror, lens, or other light directing device maycontrollably direct the emitted light based on one or more controlsignals of the dispenser MCU 74.

Regardless of the manner by which the light is directed, the dispenserMCU 74 generates control signals which cause the level display 86 toilluminate a portion 116 of the container 110 corresponding to therequested fill level R. See, e.g., FIGS. 6 and 7 . In this manner, theuser may simply look at the container 110 to confirm that the dispenser74 has correctly detected the desired fill level.

The control panel 88 is also coupled to the dispenser MCU 74. Thecontrol panel 88 may provide buttons, switches, sliders, touch panels,and/or other user input controls. The control panel 88 may generate andprovide the dispenser MCU 74 with control signals indicative of actuatedinput controls. In this manner, a user may active controls of thecontrol panel 88 to control the operation of the dispenser 70. Forexample, via the input controls of the control panel 88, the user mayselect a substance 120 (e.g., water, ice, juice, milk, etc.) that thedispenser 70 is to convey or dispense into the container 110.

As shown, the dispenser MCU 74 is further coupled to the one or moresubstance conveyors 90. Based on control signals from the dispenser MCU74, each substance conveyor 90 is configured to convey a desired orselected substance 120 from its respective substance reservoir 92 to acontainer 110 in the dispenser opening 72 via one or more dispenseroutlets 94. To this end, the substance conveyors 90 may include a pumpconfigured to pump liquid (e.g., water, juice, milk, etc.) from theappropriate reservoir 92 to the outlet 94. The substance conveyors 90may further include a worm screw, gear, or other mechanical deviceconfigured to convey a solid substance 120 (e.g., ice) from theappropriate reservoir 92 to the outlet 94.

Turning now to FIG. 5 , a flowchart depicting a dispensing method 500for one example embodiment of the dispenser 70 is shown. In particular,the dispenser 70 may generally perform the method 500 under the controlof the dispenser MCU 74. For clarity purposes, the dispensing method 500is described below with respect to dispensing water into a container110. While described with respect to dispensing water, the method 500 isalso applicable to dispensing of other substances such as ice, juice,etc.

At 510, a user may select a substance 120 to be dispensed. To this end,the user may active one or more controls of the control panel 88 toselect which substance or substances the dispenser 70 is to dispense.For example, the user may press a button on the control panel 88associated with chilled water. In response to the button being pressed,the control panel 88 may generate one or more control signals thatrequest the dispenser MCU 74 to dispense chilled water as the dispensedsubstance 120.

At 520, the dispenser 70 may detect the presence of an object in thedispenser opening 72. In particular, the user may place a container 110such as a glass, cup, mug, pitcher, bowl, etc. in the dispenser opening72. In response to the dispenser opening 72 receiving the container 110,the one or more proximity sensors 82 may detect its presence in theopening 72. The proximity sensor 82 may then generate one or morecontrol signals, which inform the dispenser MCU 74 of the presence of anobject in the opening 72.

In response to the control signals of the proximity sensor 82, thedispenser MCU 74 at 525 may awake the one or more measurement sensors80. In one example embodiment, dispenser MCU 74 may place themeasurement sensors 80 into a low-power, sleep mode during periods ofinactivity in order to conserve energy. In response to proximity sensor82 detecting an object in the opening 72, the dispenser MCU 74 maygenerate one or more control signals that awake the measurement sensors80 so that such sensors 80 may measure, measure, map, image, sense,and/or observe dimensional aspects of the object(s) in the dispenseropening 72. In some example embodiments, the dispenser MCU 74 may alsoawake the measurement sensors 80 in response to a user activating one ormore of the controls of the control panel 88.

The dispenser MCU 74 at 530 may determine based on signals of themeasurement sensors 80 whether a user's hand 130 may be present in theopening 72. In particular, the measurement sensors 80 may providesignals indicative a motion within the opening 72. The dispenser MCU 74may infer such motion may be due to the presence of a user's hand 130 inthe opening 72.

If a user's hand 130 is not present, the dispenser MCU 74 may determineat 535 whether a timeout period has elapsed since awakening themeasurement sensors 80 at 525. If the timeout period has not elapsed,the dispenser MCU 74 may return to 530 in order to further monitor forthe presence of a user's hand 130. Otherwise, the dispenser MCU 74 mayproceed to 540. At 540, the dispenser MCU 74 may generate one or moresignals that place the measurement sensors 80 in a low-power, sleepstate. After placing the measurement sensors 80 in the sleep state, thedispenser MCU 74 may cease the dispensing method 500 until re-invoked bythe user at 510.

If a user's hand 130 is detected, the dispenser MCU 74 at 550 maydetermine whether the measurement sensors 80 have detected a valid handgesture for specifying a desired fill level. Details of various exampleapproaches for detecting a valid hand gesture are presented below. Ifthe signals generated by the measurement sensors 80 are not indicativeof a valid hand gesture, then the dispenser MCU 74 at 555 may generateone or more signals that cause the main display 84 to present the userwith an appropriate message. For example, the message may inform theuser that the gesture was not recognized and that the user may wish totry again. The dispenser MCU 74 may then return to 550 in order toassess further signals received from the measurement sensors 80 for thepresence of a user's hand 130 and a valid hand gesture.

If a valid hand gesture was detected, the dispenser MCU 74 at 560 mayprocess signals from the measurement sensors 80 to ascertain the heightof the container 110. Then the dispenser MCU 74 at 570 may compare theascertained height of the container 110 to the requested fill levelspecified by the detected hand gesture. In particular, the dispenser MCU74 may verify that the requested fill level R is not greater than theascertained height H of the container 110 to ensure that dispenser 74does not attempt to fill the container 110 beyond its capacity.

In some example embodiments, the dispenser MCU 74 may further confirmthat the requested fill level is less than the detected height of thecontainer 110 by more than a margin (e.g., 0.25 inch). Such margin maybe predetermined and calculated by the dispenser MCU 74 based on theexpected accuracy by which the dispenser MCU 74 is capable of detectingthe height of the container 110, detecting the fill level requested bythe hand gesture, and/or monitoring the level of the substance 120 inthe container 110 as the container 110 is filled. In this manner, thedispenser MCU 74 may provide some tolerance to ensure the dispenser 70does spill the dispensed substance 120 as a result of overfilling thecontainer 110.

If the dispenser MCU 74 determines that the requested level is not lessthan the height of the container 110, the dispenser MCU 74 at 555 maygenerate one or more signals that cause the main display 84 to presentthe user with an appropriate message. For example, the message mayinform the user that requested fill level exceeds the capacity of thecontainer 110 and that the user may wish to try again. After presentingthe message at 555, the dispenser MCU 74 may return to 550 in order toassess further signals received from the measurement sensors 80 for thepresence of a user's hand and a valid hand gesture.

If the requested fill level R is less than the height H of the container110, then the dispenser MCU 74 at 580 may generate signals that causethe level display 86 to present the user with the requested fill levelR. In one example embodiment, the dispenser MCU 74 may generate signalsthat cause a pointing device of the level display 86 to illuminate aportion 116 of the container 110 corresponding to the requested filllevel R. As such, the dispenser MCU 74 may provide visual feedback tothe user in a manner that enables the user to quickly and easily confirmthat the requested fill level, as detected by the dispenser 70,corresponds to the fill level desired by the user.

After and/or while presenting the requested fill level R via the leveldisplay 86, the dispenser MCU 74 at 590 may generate control signalsthat cause the substance conveyor 90 to fill the container 110 with theselected substance 120 up to the requested fill level. To this end, thedispenser MCU 74 may generate signals that cause the substance conveyor90 to convey the selected substance 120 to the container 110. Uponinitiating the conveyance of the substance 120 to the container 110, thedispenser MCU 74 may generate signals that cause the display 84 topresent appropriate feedback. For example, the dispenser MCU 74 maycause the display to present the message “Begin filling.”

While the container 110 is being filled with the selected substance 120,the measurement sensors 80 may provide the dispenser MCU 74 with signalsthat are indicative of the level L of the selected substance 120 in thecontainer 110. The dispenser MCU 74 based on such signals may ascertainthe current level L of the substance 120 in the container 110. When theascertained current level of the substance 120 attains the requestedfill level R, the dispenser MCU 74 may generate signals that cause thesubstance conveyor to cease further conveyance of the substance 120 tothe outlet 94. In this manner, the dispenser MCU 74 may fill thecontainer 110 to the requested level R.

After filling the container 110 to the requested level R, the dispenserMCU 74 at 595 may generate one or more signals that cause the maindisplay 84 to present the user with an appropriate message. For example,the dispenser MCU 74 may cause the display 84 to present the message“Ready . . . ” to indicate that the dispenser 70 is done dispensing ofthe substance 120. After presenting the message at 595, the dispenserMCU 74 may return to 540 in order to place the sensors 80 in thelow-power sleep mode until the method 500 is invoked again at 510.

As noted above, the measurement sensors 80 at 550 may detect a requestedfill level R based on a hand gesture. Moreover, the measurement sensors80 at 560 detect a container height H. While shown as sequentialoperations in FIG. 5 , the sensors 80 in some example embodiments mayperform these steps in the reverse order or may perform aspects of 550and 560 concurrently. Moreover, the measurement sensors 80 may beimplemented using a variety of different types of sensors. As such, themanner by which the measurement sensors 80 obtain the requested filllevel R at 550 and/or the height H of the container 110 at 560 may varybased on the type of sensors used. Below are presented further exemplarydetails regarding various example implementations of detecting therequested fill level R at 550 and detecting the height H of thecontainer 110 at 560 for different embodiments of dispensers 70.

As shown in FIGS. 6 and 7 , the measurement sensors 80 may include anupper sensor 80 ₁ and a lower sensor 80 ₂. The upper sensor 80 ₁ may bepositioned above the opening 72 or toward the top of the opening 72. Theupper sensor 80 ₁ may be used to detect the height H of a receivedcontainer 110 as well as the level L of a substance 120 in the container110. The lower sensor 80 ₂ may be position below the opening 72 ortoward a bottom or shelf 73 of the opening 72. The lower sensor 80 ₂ maybe used to detect in free space a gesture of a user's hand 130.

To this end, the lower sensor 80 ₂ of the measurement sensors 80 mayinclude a hand gesture sensor. The hand gesture sensor may include, forexample, the MGC3030 chip available from Microchip Technologies Inc.,the Soli chip available from Google Inc, an array of ultrasonic rangesensors, or some other sensor capable of generating signal indicative ofa user's hand gesture in free space.

The MGC3030 chip is a 3D gesture controller that enables gesture baseduser interfaces in a single chip. The MGC3030 chip uses anelectrical-field (E-field) for three-dimensional (3D) gesturerecognition. The MGC3030 chip enables user command input with naturalhand movements in free-space. In particular, the MGC3030 chip canrecognize the hand position and give x, y, and z coordinates of hand 130or fingers or any other object within the E-field. The development kit,provided by Microchip Technologies Inc., provides tools that can be usedto customize the spatial arrangement of the electrodes to determine thecenter of gravity of the electric field distortion. The development kitalso includes parameter files which can be used to fine tune the gesturerecognition. As the hand 130 or part of the hand moves, the MGC3030 chipmay detect changes in x, y, and z coordinates of the center of gravityof the hand 130 or part of hand 130. Based on such detected changes inthe x, y, z coordinates of the part of hand or hand 130, the MGC3030chip may detect and recognize a gesture performed by the user's hand130.

Google Soli chip operates on a similar principle. However, the Soli chipuses a radar field instead of an E-field. The Soli chip is furthercapable of detecting small finger movements and is able to recognizegestures based on such small finger movements (e.g., a pinching motioninvolving the index finger and thumb). The Soli development kit providestools for developers to create and define new gestures.

A 2D array of ultrasonic sensors is also an option for implementing ahand gesture sensor. The 2D array of ultrasonic sensor may form beamsthat map and detect objects within the opening 72. Based on suchmapping, the 2D array of ultrasonic sensors may generate signals fromwhich the dispenser MCU 74 may detect hand gestures in the opening 72.

The MGC3030 chip and the Soli chip essentially provide self-containedsystems for detecting a hand gestures. In particular, one skilled in theart, using the provided development kits, may readily configure suchchips to detect the hand gestures noted below. As such, the followingdoes not address in detail the process for detecting the flat handgesture or finger gesture with the MGC3030 chip and the Soli chip at 550of the method 500.

As noted above, a 2D array of ultrasonic sensors 80 ₂ may be used torecognize a hand gesture such as a flat hand gesture and/or a fingergesture to specify a requested fill level. In one example embodiment,the 2D array of ultrasonic range sensors 80 ₂ are placed along thebottom shelf 73 of the opening 72 such that lower sensors 80 ₂ candetect coordinates of the palm 132 of a user's hand 130. The 2D array ofsensors 80 ₂ are capable of not only making linear measurements, i.e.,behaving as a linear array of ultrasonic sensors, but also making phaseangle measurement, i.e., behaving as a phased array of sensors with thecapability of beam forming different angles in an spherical coordinatesystem of radius r, angle θ, and angle ϕ. The dispenser 70 may use thebeam forming capability to change focal points for measuring distancesof obstacles at different points in the environment.

Referring now to FIG. 8 , a hand gesture recognition method 800 isshown, that is suitable for implementing step 550 of FIG. 5 . Inresponse to the user placing his hand 130 in the opening 72, theultrasonic sensors 80 ₂ at 810 may provide the dispenser MCU 74 withsignals indicative of measured points of the user's hand 130. Thedispenser MCU 74 may process the received measurement signals to detectthe height of the user's palm 132. See, FIG. 6 .

To this end, the dispenser MCU 74 at 820 may normalize the receivedmeasurements of the user's hand 130 by placing the received measurementsinto different buckets. In one example embodiment, each bucketcorresponds to a predefined or configurable difference (e.g., 1 mm).Placing the measurements into the buckets thus addresses minordifferences in received measurements. Moreover, suchnormalization/bucketizing may also address curvature of the user's hand130 and stress flatter areas of the palm 132. The dispenser MCU 74 mayfurther assign a normalize measurement value to each bucket. Inparticular, the normalize measurement value may be set to the mean ofthe measurements placed in the respective bucket.

At 830, the dispenser MCU 74 may process the normalized measurements todetect a height of the palm 132. In particular, assuming a flat handgesture as shown in FIG. 6 , the mode of the normalized measurementscorresponds to the height of the palm 132 of hand 130. As such, thedispenser MCU 74 may calculate the mode of the normalized measurementsto obtain the height of the palm 132 from the sensor 80 ₂.

The dispenser MCU 74 at 840 may determine whether the user has finishedmoving his hand in order to specify the requested fill level R. To thisend, the dispenser MCU 74 may determine whether the calculated mode hasremained within a predetermined threshold for a predetermined period oftime. If so, the dispenser MCU 74 at 850 may determine that the user hasstopped moving their hand 130 and may set the requested fill level R tothe calculated mode. However, if the calculated mode has varied beyondthe predetermined threshold or the predetermine period of time has yetto elapse, the dispenser MCU 74 may return to 810 in order to processfurther measurement signals from the sensors 80 ₂.

Referring now to FIG. 9 , a hand gesture recognition method 900 isshown, that is suitable for implementing step 550 of FIG. 5 in a mannerthat distinguishes between a flat hand gesture and a finger gesture.

At 910, the ultrasonic sensors 80 ₂ may use beam forming to map ormeasure an outer surface of the container 110. In this manner, theultrasonic sensors 80 ₂ may provide the dispenser MCU 74 with signalsthat specify a measured surface profile of the container 110. Inparticular, the ultrasonic sensor 80 ₂ may generate such a surfaceprofile during a time when the user's hand is not in the opening 72.

In response to the user placing his hand in the opening 72, theultrasonic sensors 80 ₂ at 920 may provide the dispenser MCU 74 withsignals indicative of measured points of the user's hand 130. Thedispenser MCU 74 may process the received measurement signals to detectthe height of the user's palm 132 or finger 134. In particular, theultrasonic sensors 80 ₂ may continue to use beam forming to map ormeasure the hand 130. In this manner, the ultrasonic sensor 80 ₂ mayprovide the dispenser MCU 74 with signals that specify a measuredsurface profile of the user's hand 130.

At 930, the dispenser MCU 74 may compare the measurement signals of thehand 130 to the surface profile of the container 110 to detect alocation of the hand 130. In particular, based on such comparison, thedispenser MCU 74 may identify an angle θ at which the difference betweenthe measurements for the hand 130 and corresponding measurements of thecontainer are greater than a threshold level.

At 940, the dispenser MCU 74, based on the angle θ and correspondingmeasurement signal, may define a plane parallel to the bottom surface ofthe opening 72 in which the hand 130 is detected. The dispenser MCU 74at 950 determines whether the hand gesture is a flat hand gesture. Tothis end, the dispenser MCU 74 may cause the sensors 80 ₂ to form onidentified plane. If a continuous obstacle is detected along such plane,the dispenser MCU 74 at 950 may infer the flat hand gesture and mayutilize the above method 800 at 960 to obtain the requested fill level Rbased on the height of the palm 132.

If not, then the dispenser MCU 74 at 970 may confirm the finger gestureof FIG. 7 . To this end, the dispenser MCU 74 may cause the lowersensors 80 ₂ to form along the identified plane, but only in the ydirection. Doing so causes the lower sensors 80 ₂ to measure along thelength of the user's finger 134, if present. If a continuous obstacle isdetected along the plane in the y direction, then the dispenser MCU 74at 970 may infer a finger gesture. In which case, the dispenser MCU 74at 980 may obtain the requested fill level R using the above method 800,but using only the measurements obtained when focusing along the planein the y direction.

Referring now to FIG. 10 , a method 1000 of detecting the height H ofthe container 110 is shown. After receiving the container 110, thedispenser MCU 74 at 1010 may cause the upper sensor 80 ₁ to scan in thex and y directions in order to identify a vertical plane (e.g., a planeparallel to the y and z axes) that intersects the rim 112 of thecontainer 110. In particular, the dispenser MCU 74 may identify asuitable vertical plane by identifying a plane in which the measurementsignals specify distances that are less than the distance from the uppersensor 80 ₁ to the shelf 73 of the opening 72.

After identifying an appropriate plane, the dispenser MCU 74 at 1020identifies measurement signals corresponding to the container rim 112.To this end, the dispenser MCU 74 may identify measurement signalscorresponding to the two shortest distances generated by the uppersensor 80 ₁. The dispenser MCU 74 may subtract such distancemeasurements from the known distance to the bottom or shelf 73 of theopening 72 upon which the container 110 rests to obtain measurements ofthe height or distance H from the shelf 73 to the rim 112. In oneexample embodiment, the dispenser MCU 74 may exclude any measurementsignals corresponding to a height greater than the height of the opening72. The dispenser MCU 74 at 1030 may then average the two shortestdistances and subtract the resulting average from the known distance tothe shelf 73 to obtain the height H of the container 110.

In an exemplary alternative embodiment, the upper sensor 80 ₁ mayprovide measurements for the total 360° around the rim 112. Thedispenser MCU 74 may then determine the height H based on the mode ofthe corresponding heights for the total 360° of the rim 112.

Referring now to FIG. 11 , a method 1100 of monitoring the level L ofthe substance 120 in the container 110 is shown. While the substance 120is dispensed into the container 110, the upper sensor 80 ₁ at 1110 mayprovide measurement signals to the dispenser MCU 74 that are indicativeof both the container 110 and the level L of the substance 120 in thecontainer 110.

The dispenser MCU 74 may filter the measurement signals to obtainmeasurements associated with the level L of the substance 120. To thisend, the dispenser MCU 74 at 1120 may select measurement signals thatspecify distances corresponding to heights from the shelf 73 that areless than the height H of the container 110, but greater than the heightof the shelf 73. Moreover, the dispenser MCU 74 at 1130 may excludemeasurement signals associated with distances that are not reducing(i.e., heights that are not increasing) at a threshold level of change.Since the dispenser 70 is in the process of filling the container 110,the level L of the substance 120 should rise in the container 110 at arelatively constant rate. Thus, any measurement signals that are notspecifying distances that are reducing at a rate of change associatedwith filling the container 110 may be excluded.

At 1140, the dispenser MCU 74 may process the remaining measurementsignals to obtain the level L of the substance 120. In particular, thedispenser MCU 74 may calculate the average of the retained measurementsignals and subtract such average from the distance to the shelf 73 toobtain the height or level L of the substance 120 in the container 110.

If the dispenser MCU 74 determines at 1150 that the level L of thesubstance 120 has yet to attain the requested fill level, then thedispenser MCU 74 may return to 1110 to continue monitoring the level Lof the substance 120 in the container 110.

As explained above, the measurement sensors 80 in one example embodimentmay include upper sensors 80 ₁ and lower sensors 80 ₂. In some exampleembodiments, the measurement sensors 80 may be implemented with a LIDAR(light detection and ranging) sensor that measures distances to a targetby illuminating the target with pulsed laser light, and measuring thereflected pulses with a sensor. A LIDAR sensor may measure distance fromitself to any point in the opening 72. In particular, the beam formingcapability of the LIDAR sensor may cover all the points in the volume ofthe opening 74. As such, the LIDAR sensor operates similar to a 3Dscanner reporting the distance or radius r, the angle θ, and the angle ϕto all the obstacles in the opening 74. Such a LIDAR sensor may beplaced at any of the six corners (e.g., back, lower, left corner) of theopening 74 in order to set the origin of the LIDAR sensor to suchcorner. The wide beam forming capability of the LIDAR sensor may be usedto detect hand gesture/finger gesture, height H of container 110,surface coordinates of the container 110, and continuously monitor thelevel L of the dispensed substance 120. As such, the LIDAR sensor mayreplace both the upper sensor 80 ₁ and lower sensor 80 ₂ resulting in asingle measurement sensor embodiment. Moreover, in such an exampleembodiment, the dispenser MCU 74 may process the measurement signals ofthe LIDAR sensor per the methods of FIGS. 8, 9, and 10 .

Various embodiments have been described herein by way of example and notby way of limitation in the accompanying figures. For clarity ofillustration, exemplary elements illustrated in the figures may notnecessarily be drawn to scale. In this regard, for example, thedimensions of some of the elements may be exaggerated relative to otherelements to provide clarity. Furthermore, where considered appropriate,reference labels have been repeated among the figures to indicatecorresponding or analogous elements.

Moreover, certain embodiments may be implemented as a plurality ofinstructions on a tangible, computer readable storage medium such as,for example, flash memory devices, hard disk devices, compact discmedia, DVD media, EEPROMs, etc. Such instructions, when executed by oneor more computing devices, may result in the one or more computingdevices such as the MCUs 40, 74 performing various aspects of theabove-described methods and/or processes.

While the present disclosure has described certain embodiments, it willbe understood by those skilled in the art that various changes may bemade and equivalents may be substituted without departing from theintended scope of protection. In addition, many modifications may bemade to adapt a particular situation or material to the teachings of thepresent disclosure without departing from its scope. Therefore, it isintended that the present disclosure not be limited to the particularembodiment or embodiments disclosed, but encompass all embodimentsfalling within the scope of the appended claims.

What is claimed is: 1-20. (canceled)
 21. A method, the methodcomprising: in a refrigeration device: generating, via one or moresensors of a dispenser, measurement signals indicative of a handpositioned in a dispenser opening; determining, via a control unit ofthe refrigeration device according to the measurement signals, a heightof the hand in free-space within the dispenser opening, wherein theheight of the hand is in relation to a bottom shelf of the dispenseropening; setting a requested fill height to the measured height of thehand within the dispenser opening; dispensing a substance into acontainer placed in the dispenser opening; and ceasing the dispensing inresponse to the substance in the container attaining the requested filllevel.
 22. The method of claim 21, wherein the one or more sensorscomprise one or more ultrasonic sensors.
 23. The method of claim 21,comprising awakening the one or more sensors in response to a proximitysensor detecting that the opening of the dispenser received an object.24. The method of claim 21, comprising detecting, via the control unit,a height of the container according to the measurement signals.
 25. Themethod of claim 24, comprising confirming, before the dispensing, thatthe requested fill level is less than the detected height of thecontainer.
 26. The method of claim 21, comprising detecting, via thecontrol unit, a level of a substance in the container according to themeasurement signals.
 27. The method of claim 21, comprising directing apointing device to illuminate a portion of the container correspondingto the requested fill level.
 28. The method of claim 21, whereindetecting the height of the hand comprises: detecting, based upon themeasurement signals, a palm of the hand within the dispenser opening anda relation of the detected palm to the container; and determining therequested fill height based upon the relation of the detected palm tothe container.
 29. The method of claim 21, wherein detecting the heightof the hand comprises: detecting, based upon the measurement signals, afinger of the hand in the dispenser opening and a relation of thedetected finger to the container; and determining the requested fillheight based upon the relation of the detected finger to the container.30. The method of claim 2:1, comprising: generating a surface map of thehand according to the measurement signals; wherein measuring the heightof the hand comprises detecting the height of the hand according to thegenerated surface map of the hand.
 31. A refrigeration device,comprising: a refrigerated compartment; a door movable between a closedstate that seals the refrigerated compartment and an opened state thatgrants access to the refrigerated compartment; a dispenser opening in anexterior surface of the door; a dispenser outlet in the dispenseropening; a reservoir configured to hold a substance; a conveyorconfigured to convey the substance from the reservoir to the dispenseroutlet; one or more sensors configured to generate measurement signalsthat are indicative of a hand in the dispenser opening; and a controlunit configured to: measure, according to the measurement signals, aheight of the hand in free-space within the dispenser opening, whereinthe height of the hand is in relation to a bottom shelf of the dispenseropening, set a requested fill height to the measured height of the hand,generate signals that cause the conveyor to convey the substance fromthe reservoir to a container placed under the dispenser outlet, andcease conveying the substance upon the container attaining the requestedfill level.
 32. The refrigeration device of claim 31, wherein the one ormore sensors comprise one or more ultrasonic sensors.
 33. Therefrigeration device of claim 31, comprising: a proximity sensorconfigured to generate a signal in response to the dispenser openingreceiving an object, wherein the control unit is configured to awakenthe one or more sensors in response to receiving the signal from theproximity sensor.
 34. The refrigeration device of claim 31, wherein thecontrol unit is configured to detect a height of the container accordingto the measurement signals.
 35. The refrigeration device of claim 34,wherein the control unit is configured to confirm that the requestedfill level is less than the detected height of the container beforecausing the conveyor to convey the substance to the container.
 36. Therefrigeration device of claim 31, wherein the control unit is configuredto detect a level of the substance in the container according to themeasurement signals.
 37. The refrigeration device of claim 31,comprising: a pointing device configured to selectively illuminateportions of the container; wherein the control unit is configured tocause the pointing device to illuminate a portion of the container thatcorresponds to the requested fill level.
 38. The refrigeration device ofclaim 31, wherein the control unit is configured to measure the heightof the hand by: detecting, based upon the measurement signals, a palm ofthe hand within the dispenser opening and a relation of the detectedpalm to the bottom shelf of the dispenser opening; and ascertain therequested fill height based upon the relation of the detected palm tothe bottom shelf of the dispenser opening.
 39. The refrigeration deviceof claim 31, wherein the control unit is configured to measure theheight of the hand by: detecting, based upon the measurement signals, afinger of the hand in the dispenser opening and a relation of thedetected finger to the bottom shelf of the dispenser opening; andascertain the requested fill height based upon the relation of thedetected finger to the bottom shelf of the dispenser opening.
 40. Therefrigeration device of claim 31, wherein the control unit is configuredto generate a surface map of hand according to the measurement signals;and detect the height of the hand according to the generated surface mapof the hand.